Information processing apparatus and non-transitory computer readable medium strong program

ABSTRACT

An information processing apparatus includes an acquirer that acquires information indicating a request from a user, and a controller that causes, in response to the request, a provider to provide first information that does not depend on a device or second information that depends on the device.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based on and claims priority under 35 USC 119 fromJapanese Patent Application No. 2017-162700 filed Aug. 25, 2017.

BACKGROUND Technical Field

The present invention relates to an information processing apparatus anda non-transitory computer readable medium storing a program.

SUMMARY

According to an aspect of the invention, there is provided aninformation processing apparatus including an acquirer that acquiresinformation indicating a request from a user, and a controller thatcauses, in response to the request, a provider to provide firstinformation that does not depend on a device or second information thatdepends on the device.

BRIEF DESCRIPTION OF THE DRAWINGS

An exemplary embodiment of the present invention will be described indetail based on the following figures, wherein:

FIG. 1 is a block diagram illustrating a device system according to anexemplary embodiment of the present invention;

FIG. 2 is a block diagram illustrating a UI apparatus;

FIG. 3 is a block diagram illustrating a terminal apparatus;

FIG. 4 illustrates an overview of a positional relationship among auser, the UI apparatus, and a device;

FIG. 5 illustrates examples of an operation mode;

FIG. 6 illustrates an overview of the positional relationship among theuser, the UI apparatus, and the device;

FIGS. 7A to 7D illustrate arrangement relationships between the UIapparatus and the device;

FIG. 8 illustrates correspondences among the positional relationship, auser's action, and the operation mode;

FIG. 9 illustrates correspondences among a type of an informationproviding method, a type of the device, and details of an operation;

FIGS. 10A to 10D illustrate Specific Example 1;

FIGS. 11A to 11C illustrate positional relationships in Specific Example1;

FIGS. 12A to 12D illustrate Specific Example 2;

FIGS. 13A to 13C illustrate positional relationships in Specific Example2;

FIGS. 14A to 14D illustrate Specific Example 3;

FIGS. 15A and 15B illustrate positional relationships in SpecificExample 3;

FIGS. 16A to 16D illustrate Specific Example 4; and

FIGS. 17A and 17B illustrate positional relationships in SpecificExample 4.

DETAILED DESCRIPTION

A device system serving as an information processing system according toan exemplary embodiment of the present invention is described withreference to FIG. 1. FIG. 1 illustrates an example of the device systemaccording to this exemplary embodiment.

The device system according to this exemplary embodiment includes a UIapparatus 10 serving as an information processing apparatus, a device12, and a terminal apparatus 14. For example, the UI apparatus 10, thedevice 12, and the terminal apparatus 14 have functions of communicatingwith each other via a communication path N such as a network. The UIapparatus 10, the device 12, and the terminal apparatus 14 maycommunicate with other apparatuses via different communication pathswithout using the communication path N. In the example illustrated inFIG. 1, a single device 12 is included in the device system but pluraldevices 12 may be included in the device system. The plural devices 12may have the same function or different functions. A single terminalapparatus 14 is included in the device system but plural terminalapparatuses 14 may be included in the device system. Depending on asituation in which the device system according to this exemplaryembodiment is applied, the terminal apparatus 14 may be omitted from thedevice system.

The UI apparatus 10 is a user interface apparatus and provides, inresponse to a user's request, information that does not depend on thedevice 12 (independent information) or information that depends on thedevice 12 (dependent information). The UI apparatus 10 has a function oftransmitting and receiving data to and from other apparatuses. Forexample, the UI apparatus 10 may acquire information from the device 12and may transmit information to the device 12.

The independent information is information that is not unique to thedevice 12 (information that is not related to the device 12). Theindependent information may further be information that is not unique tothe user (information that is not related to the user). That is, theindependent information may be information that does not depend on thedevice 12 and is not unique to the user. The independent informationcorresponds to an example of first information.

The dependent information is information unique to the device 12(information related to the device 12). The dependent information mayfurther be information unique to the user (information related to theuser). That is, the dependent information may be information thatdepends on the device 12 and is unique to the user. More specifically,the dependent information is information unique to the user about thedevice 12. The dependent information corresponds to an example of secondinformation.

The device 12 is a device having a function, such as an image formingdevice having an image forming function, a personal computer (PC), aprojector, a vending machine, a coffee machine, a telephone, a displaydevice such as a liquid crystal display, a refrigerator, a microwaveoven, an air purifier, a cleaner, or a game console. The category of thedevice 12 may include devices in general. The device 12 has a functionof transmitting and receiving data to and from other apparatuses.

In this exemplary embodiment, the device 12 is, for example, an imageforming device. The image forming device (device 12) has at least oneof, for example, a scanning function, a printing function, a copyingfunction, and a facsimile function. By executing the scanning function,a document is read and scan data (image data) is generated. By executingthe printing function, an image is printed on a recording medium such aspaper. By executing the copying function, a document is read and printedon a recording medium. By executing the facsimile function, image datais transmitted or received by facsimile. A cooperative function thatuses plural functions may be executed. For example, ascanning/transferring function that is a combination of the scanningfunction and a transmitting function (transferring function) may beexecuted. By executing the scanning/transferring function, a document isread and scan data (image data) is generated. Then, the scan data istransmitted to an external apparatus. This cooperative function ismerely an example and a different cooperative function may be executed.

The terminal apparatus 14 is an apparatus such as a personal computer(PC), a tablet PC, a smartphone, or a mobile phone and has a function oftransmitting and receiving data to and from other apparatuses. Theterminal apparatus 14 may also be a wearable terminal (such as awristwatch type terminal, a wristband type terminal, an eyeglass typeterminal, a ring type terminal, a contact lens type terminal, abody-embedded type terminal, or a bearable terminal).

The configuration of the UI apparatus 10 is described below in detailwith reference to FIG. 2. FIG. 2 illustrates an example of theconfiguration of the UI apparatus 10.

A communication part 16 is a communication interface and has functionsof transmitting data to other apparatuses and receiving data from otherapparatuses. The communication part 16 may be a communication interfacehaving a wireless communication function or a wired communicationfunction. For example, the communication part 16 may be compatible withone or plural types of communication scheme and communicate with acommunication partner in accordance with a communication scheme suitablefor the communication partner (that is, a communication scheme that thecommunication partner is compatible with). For example, thecommunication scheme is infrared communication, visible lightcommunication, Wi-Fi (registered trademark) communication, or closeproximity wireless communication (for example, near field communication(NFC)). Examples of the close proximity wireless communication to beused include Felica (registered trademark), Bluetooth (registeredtrademark), and radio frequency identifiers (RFID). Wirelesscommunication that employs a different scheme may be used as the closeproximity wireless communication. For example, the communication part 16may switch the communication scheme or the frequency band in accordancewith a communication partner or a surrounding environment.

A UI part 18 is a user interface and includes a display part and anoperation part. For example, the display part is a display device suchas a liquid crystal display. For example, the operation part is an inputdevice such as a touch panel or a keyboard. A user interface thatfunctions as both of the display part and the operation part (includinga touch display or a device that electronically displays a keyboard orthe like on a display) may be used as well. The UI part 18 may include asound collecting part such as a microphone or a sound generating partsuch as a loudspeaker. In this case, information may be input to the UIapparatus 10 by audio input or information may be output by sound.

A positional information acquiring part 20 has a function of acquiringpieces of information indicating the positions of the user, the UIapparatus 10, the device 12, and the terminal apparatus 14 (positionalinformation). By using those pieces of positional information, apositional relationship among the user, the UI apparatus 10, the device12, and the terminal apparatus 14 is detected. If the user carries theterminal apparatus 14, the positional information acquiring part 20 mayacquire the positional information of the user or the terminal apparatus14. For example, the positional information acquiring part 20 may detecta relative position of the device 12 to the UI apparatus 10 based on thestrength of a signal used in the communication between the UI apparatus10 and the device 12 and detect a relative position of the terminalapparatus 14 to the UI apparatus 10 based on the strength of a signalused in the communication between the UI apparatus 10 and the terminalapparatus 14. The positional information acquiring part 20 may acquirethe positional information of each of the UI apparatus 10, the device12, and the terminal apparatus 14 by using a global positioning system(GPS) function. If an object (for example, the user) is imaged by animaging device such as a camera, the positional information acquiringpart 20 may detect a relative position of the object to the UI apparatus10 based on an image generated by the imaging.

The positional information acquiring part 20 may be provided in thedevice 12 instead of the UI apparatus 10 or may separately be providedoutside the UI apparatus 10 or the device 12.

A request information acquiring part 22 has a function of acquiringinformation indicating a user's request (request information). Forexample, the request information acquiring part 22 may presume(determine) the user's request based on the position of the user, audioinput, an operation for the UI part 18, or a user's action (for example,a gesture).

A storage part 24 is a storage device such as a hard disk drive or amemory (for example, an SSD). The storage part 24 stores the dependentinformation, the independent information, various types of data, variousprograms, information indicating an address of the UI apparatus 10(address information), information indicating addresses of otherapparatuses (for example, the device 12 and the terminal apparatus 14)(address information), and the like. Those pieces of information may bestored in different storage devices or a single storage device. Thedependent information and the independent information need not be storedin the storage part 24.

A control part 26 has a function of controlling operations of therespective parts of the UI apparatus 10. For example, the control part26 controls communication performed by the communication part 16 andinformation display on the display part of the UI part 18. The controlpart 26 includes an information providing part 28.

The information providing part 28 has a function of providinginformation in response to the user's request. The information providingpart 28 may display the information on the display part of the UI part18 in response to the user's request, may output the information assound by using the loudspeaker, or may transmit the information to theterminal apparatus 14.

For example, the information providing part 28 provides informationbased on a positional relationship among the user, the UI apparatus 10,and the device 12, the request information, the type of the device 12,the state of the device 12, and an information providing method. Theinformation to be provided is the dependent information or theindependent information described above. The information providing part28 may provide the dependent information or the independent informationby acquiring the dependent information or the independent informationfrom the storage part 24, may acquire the dependent information or theindependent information from an external apparatus (for example, aserver), or may search for the dependent information or the independentinformation to be provided by using the Internet or the like and providethe dependent information or the independent information as a result ofthe search.

When a user is identified, the information providing part 28 may providedependent information unique to the user. For example, the user isidentified by using biometric authentication or an IC card. Examples ofthe biometric authentication to be used include facial recognitionauthentication, voice recognition authentication, fingerprintrecognition authentication, iris recognition authentication, retinarecognition authentication, and palm vein recognition authentication.For example, a user's face is imaged by the imaging device such as acamera and the control part 26 identifies the user subjected to theimaging by applying the facial recognition authentication technology toan image generated by the imaging. The voice recognition authenticationor the like is executed similarly to the facial recognitionauthentication. Information recorded on an IC card such as an employeeID card or a student ID card may be read by a reading device provided inor near the UI apparatus 10 and the control part 26 may identify theuser based on the read information. For example, personal information ofthe user (for example, a name, an age, a sex, or an organization) isrecorded on the IC card and the control part 26 identifies the userbased on the recorded information. When the user is identified asdescribed above, the information providing part 28 may acquireinformation related to the identified user (user information) andprovide dependent information based on the acquired information. Forexample, the information providing part 28 acquires user's scheduleinformation, user's organization information, or the personalinformation described above as the user information and providesdependent information based on the acquired information. The scheduleinformation is a record of a user's schedule in the future, actions inthe past, and the like. The information providing part 28 may acquirethe user information from the terminal apparatus 14 carried by the useror from an apparatus other than the terminal apparatus 14 (for example,a server).

The configuration of the terminal apparatus 14 is described below indetail with reference to FIG. 3. FIG. 3 illustrates an example of theconfiguration of the terminal apparatus 14.

A communication part 30 is a communication interface and has functionsof transmitting data to other apparatuses and receiving data from otherapparatuses. The communication part 30 may be a communication interfacehaving a wireless communication function or a wired communicationfunction. For example, the communication part 30 may be compatible withone or plural types of communication scheme and communicate with acommunication partner in accordance with a communication scheme suitablefor the communication partner. For example, the communication part 30may switch the communication scheme or the frequency band in accordancewith a communication partner or a surrounding environment.

A UI part 32 is a user interface and includes a display part and anoperation part. For example, the display part is a display device suchas a liquid crystal display. For example, the operation part is an inputdevice such as a touch panel or a keyboard. A user interface thatfunctions as both of the display part and the operation part may be usedas well.

A storage part 34 is a storage device such as a hard disk drive or amemory (for example, an SSD). The storage part 34 stores various typesof data, various programs, information indicating addresses of otherapparatuses (for example, the UI apparatus 10 and the device 12)(address information), and the like. Those pieces of information may bestored in different storage devices or a single storage device.

A control part 36 has a function of controlling operations of therespective parts of the terminal apparatus 14. For example, the controlpart 36 controls communication performed by the communication part 30and information display on the display part of the UI part 32.

An overview of the positional relationship among the user, the UIapparatus 10, and the device 12 is described below with reference toFIG. 4. FIG. 4 illustrates the positional relationship. For example, auser 38 carries the terminal apparatus 14. For example, the control part26 of the UI apparatus 10 defines areas based on the position of the UIapparatus 10, the position of the device 12, or other positions (forexample, a position based on the positions of both of the UI apparatus10 and the device 12). For example, the control part 26 defines theareas based on the strength of the signal used in the communicationbetween the devices or an imaging result from the imaging device. In theexample illustrated in FIG. 4, two areas (first area 40 and second area42) are defined. The second area 42 is defined outside the first area40. Three or more areas or a single area may be defined. The shape ofeach area is a circular shape, an elliptical shape, a rectangular shape,or the like. The shape of each area may be any other arbitrary shape. Amethod for defining the areas is described in detail later.

For example, the information providing part 28 provides information (forexample, dependent information or independent information) based on theposition of the user 38 (terminal apparatus 14). The positionalinformation of the user 38 is acquired by the positional informationacquiring part 20. For example, the information providing part 28provides information based on a situation in which the user 38 islocated outside the second area 42, within the second area 42, or withinthe first area 40.

Information to be provided by the information providing part 28 isdescribed below in detail with reference to FIG. 5. FIG. 5 illustratesexamples of an operation mode to be executed by the UI apparatus 10. Ina broad category, the information providing part 28 executes a publicproviding mode represented by reference symbol 44 or an on-demandproviding mode represented by reference symbol 46.

For example, the public providing mode includes a power saving mode anda general information providing mode (reference symbol 44A).

For example, the power saving mode is a mode in which the power of thedisplay part of the UI apparatus 10 is kept in a standby state. In thepower saving mode, the information providing part 28 does not provideinformation.

The general information providing mode is a mode in which theindependent information (information that does not depend on the device12 and is not unique to the user) is provided. In the generalinformation providing mode, the information providing part 28 provides,for example, general information in a company, weather information, oradvertisement information as the independent information. Theinformation providing part 28 may provide those pieces of information byacquiring the information via a communication path such as the Internetor a local area network (LAN). The information providing part 28 maydisplay the independent information on the UI part 18 or may output theindependent information as audio information by sound from theloudspeaker.

For example, the on-demand providing mode includes a conversation mode(reference symbol 46A), an information providing mode (reference symbol46B), and an operating mode (reference symbol 46C).

The conversation mode (reference symbol 46A) is a mode in which the userand the UI apparatus 10 have a conversation (corresponding to a firstmode). In the conversation mode, the information providing part 28 has aconversation with the user by using, for example, artificialintelligence (AI). The information providing part 28 analyzes a user'sspeech or action to provide a response to the speech or action. Theinformation providing part 28 may display information indicating theresponse on the UI part 18 or may output the response information asaudio information by sound from the loudspeaker. For example, theinformation providing part 28 may provide a question about the device 12to the user or may receive a response about the device 12 from the userand provide information related to the response to the user. Theinformation providing part 28 may have a learning function that uses theartificial intelligence and have an ability to make a determinationclose to the human level owing to the learning function. There may beused neural network type deep learning or reinforcement learning inwhich a learning field is partially reinforced. In addition, there maybe used genetic algorithms, cluster analysis, self-organizing maps,ensemble learning, or the like. There may be used technologies relatedto the artificial intelligence other than the above-mentionedtechnologies. The information to be provided in the conversation mode isinformation related to the conversation with the user and may thereforebe regarded as information unique to the user. When a conversationrelated to the device 12 is made, this event may be regarded as asituation in which the dependent information of the device 12 isprovided to the user.

The information providing mode (reference symbol 46B) is a mode in whichthe dependent information (information that depends on the device 12,information unique to the user, or information unique to the user aboutthe device 12) is provided (corresponding to a second mode). In theinformation providing mode, the information providing part 28 provides,for example, the information related to the device 12 or the informationunique to the user about the device 12 as the dependent information. Theinformation providing part 28 may display the dependent information onthe UI part 18 or may output the dependent information as audioinformation by sound from the loudspeaker. The information providingpart 28 may acquire the information related to the device 12 from thedevice 12 itself or from an external apparatus such as a server.

The operating mode (reference symbol 46C) is a mode in which informationrelated to an operation for the device 12 is provided (corresponding toa third mode). In the operating mode, the information providing part 28provides, for example, information for setting details of processing tobe executed by the device 12 (for example, information for setting anoperation condition or a processing condition of the device 12) orinformation for giving an instruction to execute the processing as theinformation related to the operation for the device 12. The informationproviding part 28 may provide a screen for editing information to beprocessed by the device 12 (for example, document data or image data).The information providing part 28 may display the information related tothe operation for the device 12 on the UI part 18 or may output theinformation as audio information by sound from the loudspeaker. Theinformation to be provided in the operating mode is the informationrelated to the operation for the device 12 and may therefore be regardedas the dependent information of the device 12. When operationinformation unique to the user is provided, this event may be regardedas a situation in which the information unique to the user is providedto the user.

In the on-demand providing mode, the information providing part 28executes any one of the conversation mode (reference symbol 46A), theinformation providing mode (reference symbol 46B), and the operatingmode (reference symbol 46C) by switching the conversation mode(reference symbol 46A), the information providing mode (reference symbol46B), and the operating mode (reference symbol 46C) based on, forexample, the positional relationship among the user, the UI apparatus10, and the device 12, the request information, the type of the device12, the state of the device 12, and the information providing method.

Processing for detecting the positional relationship among the user, theUI apparatus 10, and the device 12 is described below with reference toFIG. 6. FIG. 6 illustrates an overview of the positional relationship.

For example, the positional information acquiring part 20 detects arelative positional relationship between the UI apparatus 10 and thedevice 12 based on the strength of the signal used in the communicationbetween the UI apparatus 10 and the device 12 and detects a relativepositional relationship between the UI apparatus 10 and the terminalapparatus 14 carried by the user based on the strength of the signalused in the communication between the UI apparatus 10 and the terminalapparatus 14 (user). For example, Bluetooth Low Energy (BLE) is used fordetecting the position based on the signal strength. A communicationscheme other than Bluetooth Low Energy may be used.

As another example, the imaging device such as a camera may image anobject (for example, the user or the device 12) and the positionalinformation acquiring part 20 may detect a relative positionalrelationship between the UI apparatus 10 and the object based on animage generated by the imaging. An imaging area 48 is defined by anangle of view of the camera provided in the UI apparatus 10 and anobject in the imaging area 48 is imaged. The positional informationacquiring part 20 may detect the positional relationship based on bothof the communication signal strength and the image.

The control part 26 of the UI apparatus 10 defines the first area 40 andthe second area 42 based on the communication signal strength describedabove. For example, the first area 40 and the second area 42 are hereindefined based on the position of the UI apparatus 10.

The control part 26 defines, as the first area 40, an area where thesignal strength of the communication with the UI apparatus 10 is equalto or higher than a predetermined first strength threshold. The controlpart 26 defines, as the second area 42, an area where the signalstrength of the communication with the UI apparatus 10 is lower than thefirst strength threshold and is equal to or higher than a predeterminedsecond strength threshold. The second strength threshold is lower thanthe first strength threshold. An area where the signal strength of thecommunication with the UI apparatus 10 is lower than the second strengththreshold is an area outside the second area.

For example, when the signal strength of the communication between theUI apparatus 10 and the terminal apparatus 14 carried by the user isequal to or higher than the first strength threshold, the control part26 determines that the user is located within the first area 40. Whenthe signal strength of the communication between the UI apparatus 10 andthe terminal apparatus 14 is lower than the first strength threshold andis equal to or higher than the second strength threshold, the controlpart 26 determines that the user is located within the second area 42.

When an object is imaged by the imaging device, the control part 26 maydetermine the area where the user is located by using a result ofanalysis of an image generated by the imaging. For example, when theratio of an image showing a user's face to the entire image generated bythe imaging (for example, the ratio of the area of the face image to thearea of the entire image) is equal to or higher than a first ratiothreshold, the control part 26 determines that the user is locatedwithin the first area 40. When the ratio of the face image is lower thanthe first ratio threshold and is equal to or higher than a second ratiothreshold, the control part 26 determines that the user is locatedwithin the second area 42.

The control part 26 may detect the location of the user by using both ofthe communication signal strength and the image analysis result. Forexample, when the signal strength of the communication between the UIapparatus 10 and the terminal apparatus 14 is equal to or higher thanthe first strength threshold and when the ratio of the face image isequal to or higher than the first ratio threshold, the control part 26determines that the user is located within the first area 40. As anotherexample, when the signal strength is equal to or higher than the firststrength threshold or when the ratio of the face image is equal to orhigher than the first ratio threshold, the control part 26 may determinethat the user is located within the first area 40.

When the communication signal strength is lower than the first strengththreshold and is equal to or higher than the second strength thresholdand when the ratio of the face image is lower than the first ratiothreshold and is equal to or higher than the second ratio threshold, thecontrol part 26 may determine that the user is located within the secondarea 42. As another example, when the communication signal strength islower than the first strength threshold and is equal to or higher thanthe second strength threshold or when the ratio of the face image islower than the first ratio threshold and is equal to or higher than thesecond ratio threshold, the control part 26 may determine that the useris located within the second area 42.

By using both of the communication signal strength and the imageanalysis result, the user detection accuracy is improved compared with acase of using one of the communication signal strength and the imageanalysis result. Depending on, for example, user's body features (forexample, a height) or use of a wheelchair, the user's face may belocated outside the imaging area of the imaging device in a heightdirection. In this case, the position of the user is detected moreaccurately by using the communication signal strength.

An arrangement relationship between the UI apparatus 10 and the device12 is described below with reference to FIGS. 7A to 7D. FIGS. 7A to 7Dillustrate examples of the arrangement relationship. For example, thedevice 12 has a front side 12 a, a rear side 12 b, a right side 12 c,and a left side 12 d. FIG. 7A illustrates a positional relationship (a).In the positional relationship (a), the UI apparatus 10 is arranged withspacing from the device 12 or in contact with the right side 12 c of thedevice 12 at a position where the UI apparatus 10 faces the right side12 c. FIG. 7B illustrates a positional relationship (b). In thepositional relationship (b), the UI apparatus 10 is arranged withspacing from the device 12 or in contact with the left side 12 d of thedevice 12 at a position where the UI apparatus 10 faces the left side 12d. FIG. 7C illustrates a positional relationship (c). In the positionalrelationship (c), the UI apparatus 10 is arranged with spacing from thedevice 12 or in contact with the rear side 12 b of the device 12 at aposition where the UI apparatus 10 faces the rear side 12 b. FIG. 7Dillustrates a positional relationship (d). In the positionalrelationship (d), the UI apparatus 10 is arranged on top of the device12. The arrangement relationships illustrated in FIGS. 7A to 7D aremerely examples and the UI apparatus 10 and the device 12 may bearranged in an arrangement relationship other than those arrangementrelationships.

An operation mode to be executed based on the positional relationshipand the user's action is described below in detail with reference toFIG. 8. FIG. 8 illustrates correspondences among the positionalrelationship, the user's action, and the operation mode.

In positional relationships (a1), (a2), (a3), and (a4), the positionalrelationship between the UI apparatus 10 and the device 12 is identicalto the positional relationship (a) illustrated in FIG. 7A and the UIapparatus 10 is arranged close to the right side 12 c of the device 12.In positional relationships (b1), (b2), (b3), and (b4), the positionalrelationship between the UI apparatus 10 and the device 12 is identicalto the positional relationship (b) illustrated in FIG. 7B and the UIapparatus 10 is arranged close to the left side 12 d of the device 12.In positional relationships (c1), (c2), and (c3), the positionalrelationship between the UI apparatus 10 and the device 12 is identicalto the positional relationship (c) illustrated in FIG. 7C and the UIapparatus 10 is arranged close to the rear side 12 b of the device 12.In positional relationships (d1), (d2), and (d3), the positionalrelationship between the UI apparatus 10 and the device 12 is identicalto the positional relationship (d) illustrated in FIG. 7D and the UIapparatus 10 is arranged on top of the device 12. In FIG. 8, the user 38(terminal apparatus 14) is indicated by a circular object, the firstarea 40 is indicated by a solid line, and the second area 42 isindicated by a broken line.

In the positional relationships (a1), (a2), (a3), (a4), (b1), (b2),(b3), and (b4), the first area 40 and the second area 42 are definedbased on the position of the UI apparatus 10. In the positionalrelationships (c1), (c2), and (c3), the first area 40 and the secondarea 42 are defined based on the position of the device 12. In thepositional relationships (d1), (d2), and (d3), the first area 40 and thesecond area 42 are defined based on the position of the UI apparatus 10or the device 12.

As the user's action (gesture), an action a, an action β, and an actionγ are exemplified. The action α indicates a state in which the user doesnot execute any specific action. The action β is a specific actionrelated to the line of sight of the user. For example, the action β issuch an action that the user turns the line of sight to the UI apparatus10 or the device 12. The action γ is such a specific action that theuser moves the hand closer to the UI apparatus 10 or the device 12.

For example, the imaging device such as a camera is provided in or nearthe UI apparatus 10 and the user is imaged by the imaging device. Therequest information acquiring part 22 acquires image data obtained bythe imaging (still image data or moving image data) from the imagingdevice and detects the user's action by analyzing the image data.Evaluation may be made to indicate that the user's action reflects auser's request. The request information acquiring part 22 detects theuser's action to acquire information indicating the user's action asinformation indicating the user's request. For example, the requestinformation acquiring part 22 analyzes the image data to detect the lineof sight of the user that corresponds to the action β or the movement ofthe hand that corresponds to the action γ. The request informationacquiring part 22 acquires the action as the user's request.

Information indicating correspondence among the positional relationship,the user's action, and the operation mode illustrated in FIG. 8 iscreated in advance and is stored in the storage part 24 of the UIapparatus 10. The information providing part 28 executes the operationmode associated with the positional relationship and the user's actionby referring to the information indicating the correspondence (forexample, the table illustrated in FIG. 8).

The operation mode to be executed is described below in detail takingspecific examples.

For example, when the user 38 is located outside the second area 42 asin the positional relationships (a1), (b1), (c1), and (d1) (that is,when the control part 26 determines that the user is located neitherwithin the first area 40 nor within the second area 42), the informationproviding part 28 executes the public providing mode (reference symbol44A) irrespective of the details of the detected user's action. When theuser 38 is located outside the second area 42, the public providing modeis executed irrespective of the positional relationship among the user38, the UI apparatus 10, and the device 12. As the public providingmode, the information providing part 28 may execute the power savingmode or the general information providing mode. In the generalinformation providing mode, the information providing part 28 provides,for example, general information in a company, weather information, oradvertisement information as the independent information. When the user38 is located outside the second area 42, it is predicted that thepossibility of use of the UI apparatus 10 or the device 12 by the user38 at that timing is lower than in the case in which the user 38 islocated within the first area 40 or the second area 42. Therefore, thepublic providing mode (the power saving mode in which information is notprovided or the general information providing mode in which informationthat is not unique to the user 38 is provided) is executed.

When the user 38 is located at a position other than the front side ofthe device 12 and the front side of the UI apparatus 10 within thesecond area 42 as in the positional relationships (a2) and (b2) (thatis, when the control part 26 determines that the user is located at aposition other than the front side of the device 12 and the front sideof the UI apparatus 10 within the second area 42), the informationproviding part 28 executes the information providing mode (referencesymbol 46B) as the on-demand providing mode irrespective of the detailsof the detected user's action. Similarly when the user 38 is located ata position corresponding to the front side of the UI apparatus 10 withinthe second area 42 as in the positional relationships (c2) and (d2)(that is, when the control part 26 determines that the user is locatedat a position corresponding to the front side of the UI apparatus 10within the second area 42), the information providing part 28 executesthe information providing mode (reference symbol 46B) as the on-demandproviding mode irrespective of the details of the detected user'saction. In the information providing mode, as described above, the user38 is identified and the information providing part 28 providesinformation unique to the user 38 about the device 12. When the user 38is located at a position corresponding to the front side of the UIapparatus 10 within the second area 42 or at a position other than thefront side of the device 12 within the second area 42, it is predictedthat the possibility of use of the UI apparatus 10 or the device 12 bythe user 38 at that timing is higher than in the case in which the user38 is located outside the second area 42. Therefore, the on-demandproviding mode is executed. When the user 38 is located at a positioncorresponding to the front side of the UI apparatus 10 or at a positionother than the front side of the device 12 within the second area 42, itis predicted that the possibility of use of the UI apparatus 10 or thedevice 12 by the user 38 at that timing is lower than in the case inwhich the user 38 is located within the first area 40. Therefore, theinformation providing mode is executed as the on-demand providing mode.

When the user 38 is located within the first area 40 as in thepositional relationships (a3), (b3), (c3), and (d3) (that is, when thecontrol part 26 determines that the user 38 is located within the firstarea 40), the information providing part 28 executes an operation modebased on the user's action. The information providing part 28 executesan operation mode based on the user's action irrespective of the actualposition of the user 38 within the first area 40.

For example, when the action α is detected as the user's action, theinformation providing part 28 executes the information providing mode(reference symbol 46B) as the on-demand providing mode. In theinformation providing mode, the user 38 is identified and theinformation providing part 28 provides dependent information related tothe user by acquiring information on the identified user 38 (userinformation) and analyzing the user information. When the user 38 islocated within the first area 40 but no specific action (for example, anaction related to the line of sight or an action of moving closer to theUI apparatus 10 or the device 12) is executed by the user 38, it ispredicted that the possibility of use of the UI apparatus 10 or thedevice 12 by the user 38 is lower than in the case in which the specificaction is executed. Therefore, the information providing mode isexecuted as the on-demand providing mode.

When the action β is detected as the user's action, the informationproviding part 28 executes the conversation mode (reference symbol 46A)as the on-demand providing mode. In the conversation mode, the user 38is identified and the information providing part 28 has a conversationwith the user 38 by using, for example, the artificial intelligence. Inthis case, the information providing part 28 provides, to the user 38, aunique question or response related to the user by acquiring informationon the identified user 38 (user information) and analyzing the userinformation.

When the action γ is detected as the user's action, the informationproviding part 28 executes the operating mode (reference symbol 46C) asthe on-demand providing mode. In the operating mode, the informationproviding part 28 provides information related to an operation for thedevice 12. In the operating mode, the user 38 is identified and theinformation providing part 28 provides operation information that isrelated to the operation for the device 12 and is unique to the user 38by acquiring information on the identified user 38 (user information)and analyzing the user information.

When the user 38 is located at a position corresponding to the frontside of the device 12 within the second area 42 as in the positionalrelationships (a4) and (b4) (that is, when the control part 26determines that the user is located in front of the device 12 within thesecond area 42), the information providing part 28 executes an operationmode based on the user's action.

For example, when the action α or the action β is detected as the user'saction, the information providing part 28 executes the informationproviding mode (reference symbol 46B) as the on-demand providing mode.When the action γ is detected as the user's action, the informationproviding part 28 executes the conversation mode (reference symbol 46A)as the on-demand providing mode. When the user is located in front ofthe device 12 within the second area 42 but the action of moving closerto the UI apparatus 10 or the device 12 is not executed by the user 38,it is predicted that the possibility of use of the UI apparatus 10 orthe device 12 by the user 38 is lower than in the case in which theaction of moving closer to the UI apparatus 10 or the device 12 isexecuted. Therefore, when the action a or the action β is detected, theinformation providing mode is executed. When the action γ (action ofmoving closer to the UI apparatus 10 or the device 12) is detected, theuser may execute some operation and therefore the conversation mode(reference symbol 46A) is executed.

An operation mode to be executed based on the positional relationship,the user's action, and the state of the device 12 is described below.

For example, when the state of the device 12 corresponds to a standbystate or an operating state and the action α, the action β, or theaction γ is detected as the user's action, the information providingpart 28 executes an operation mode based on the positional relationshipand the detected user's action illustrated in FIG. 8. The standby stateis a state in which the power supply to a part of the device 12 isstopped. The operating state is a state in which the device 12 isactivated and processing is executable.

When the state of the device 12 corresponds to an error state, theinformation providing part 28 executes the conversation modeirrespective of the positional relationship and the user's action. Forexample, when a paper jam has occurred in the image forming deviceserving as the device 12, the information providing part 28 acquireserror information related to the paper jam from the image forming deviceand outputs the error information in the conversation mode.

When the state of the device 12 corresponds to the error state, theinformation providing part 28 may execute the conversation mode toprovide information related to a different device that meets the user'srequest. For example, the UI apparatus 10 communicates with pluraldevices (including the device 12) to acquire information related to eachdevice (for example, information related to the state of each device,information related to the function of each device, or informationrelated to the installation position of each device). The UI apparatus10 may acquire the information related to each device at regular orirregular intervals or at arbitrary timings. When the state of thedevice 12 corresponds to the error state, the information providing part28 identifies a device that meets the user's request by referring toinformation related to each device other than the device 12 and providesinformation related to the identified device to the user. Theinformation providing part 28 may preferentially provide informationrelated to a device that is installed at a position closer to a currentposition of the user. For example, the information providing part 28provides, as information having the highest priority, informationrelated to a device that is installed at a position closest to thecurrent position of the user. Further, the information providing part 28provides, as information having a lower priority, information related toa device that is installed at a position farther away from the currentposition of the user. The information providing part 28 may provideinformation related to the installation position of a different device.The information related to a different device may be displayed on thedisplay part of the UI part 18 or may be output by sound.

When the state of the device 12 corresponds to the error state but theerror corresponds to an error that does not hinder the device 12 frommeeting the user's request, the information providing part 28 mayexecute the information providing mode or the operating mode based onthe user's action. For example, as illustrated in FIG. 8, theinformation providing part 28 executes the information providing mode orthe operating mode based on the positional relationship and the user'saction. The conversation mode may be executed depending on thepositional relationship and the user's action (see FIG. 8). For example,when paper contained in the image forming device serving as the device12 has run out, the state of the image forming device becomes the errorstate. In this case, the copying function or the printing functionremains inexecutable unless the paper is replenished. The scanningfunction (function of reading a document and generating image data) doesnot use paper and is therefore executable even if the paper is notreplenished. When the user's request indicates the execution of thescanning function, the information providing part 28 executes theinformation providing mode or the operating mode based on acorrespondence between the positional relationship and the user'saction. For example, when the positional relationship corresponds to thepositional relationship (a3), (b3), (c3), or (d3) in FIG. 8 and theuser's action corresponds to the action α, the information providingpart 28 executes the information providing mode (reference symbol 46B).When this positional relationship holds and the user's actioncorresponds to the action γ, the information providing part 28 executesthe operating mode (reference symbol 46C). By executing the controldescribed above, processing is executed in response to the user'srequest when the error has occurred but the error does not affect theuser's request.

Details of the information providing operation (how the informationproviding operation is performed) based on the type of the informationproviding method and the type of the device 12 are described below indetail with reference to FIG. 9. FIG. 9 illustrates correspondencesamong the type of the information providing method, the type of thedevice 12, and details of the operation (how the operation isperformed).

FIG. 9 illustrates “visual”, “audio”, and “general” as examples of theinformation providing method.

The “visual” providing method is a method of providing information bydisplaying the information. For example, when the “visual” providingmethod is executed, information provided by the information providingpart 28 is displayed on the display part of the UI part 18. As anotherexample, the information provided by the information providing part 28may be transmitted from the UI apparatus 10 to the terminal apparatus 14and displayed on the UI part 32 of the terminal apparatus 14. Forexample, the “visual” providing method is executed when the informationprovided by the information providing part 28 corresponds to informationdisplayable on the display part (for example, an image or a characterstring), when the display part is provided in the UI apparatus 10, orwhen the display part is provided in the terminal apparatus 14. Theinformation provided by the information providing part 28 may betransmitted from the UI apparatus 10 to the device 12 and displayed on adisplay part of the device 12.

The “audio” providing method is a method of providing information bysound. For example, when the “audio” providing method is executed,information provided by the information providing part 28 is output assound from the loudspeaker provided in the UI apparatus 10. As anotherexample, the information provided by the information providing part 28may be transmitted from the UI apparatus 10 to the terminal apparatus 14and output as sound from a loudspeaker provided in the terminalapparatus 14. For example, the “audio” providing method is executed whenthe information provided by the information providing part 28corresponds to information outputtable as audio information (forexample, audio information itself or a character string), when theloudspeaker is provided in the UI apparatus 10, or when the loudspeakeris provided in the terminal apparatus 14. The information provided bythe information providing part 28 may be transmitted from the UIapparatus 10 to the device 12 and output as audio information from thedevice 12.

The “general” providing method is an information providing method thatis common to the “visual” and “audio” providing methods. For example,the “general” providing method may be executed along with the executionof the “visual” providing method or the execution of the “audio”providing method. Both the “visual” and “audio” providing methods may beexecuted.

FIG. 9 illustrates a “multifunction peripheral”, a “projector”, and“devices in general” as examples of the type of the device 12. The“multifunction peripheral” serving as the device 12 corresponds to anexample of the image forming device and has at least one of, forexample, the scanning function, the printing function, the copyingfunction, and the facsimile function. The “projector” serving as thedevice 12 is a device having a function of projecting an image.Information to be provided to the “multifunction peripheral” and the“projector” in common is defined in each item corresponding to the“devices in general”.

Details of the information providing operation (how the informationproviding operation is performed) are defined in association with thetype of the information providing method and the type of the device 12.The information providing part 28 provides information in accordancewith the details of the information providing operation (how theinformation providing operation is performed). Information indicatingthe correspondence among the type of the information providing method,the type of the device 12, and the details of the information providingoperation (how the information providing operation is performed)illustrated in FIG. 9 is defined in advance and is stored in the storagepart 24 of the UI apparatus 10. For example, the information providingpart 28 executes the details of the operation associated with theinformation providing method and the type of the device 12 by referringto the information indicating the correspondence (for example, the tableillustrated in FIG. 9).

The details of the information providing operation are described belowin detail taking specific examples.

When the device 12 is the “multifunction peripheral” and the “visual”providing method is used and when the on-demand providing mode describedabove is executed, the information providing part 28 executes the“conversation mode”, the “information providing mode”, or the “operatingmode” by switching the “conversation mode”, the “information providingmode”, and the “operating mode” based on the positional relationship andthe user's action.

When the device 12 is the “multifunction peripheral” and the “audio”providing method is used and when it is detected that the user islocated within the first area 40, the information providing part 28provides information by sound. When it is detected that the user islocated within the second area 42, the information providing part 28does not provide information by sound.

When the device 12 is the “multifunction peripheral” and the “general”providing method is used, the control part 26 controls the UI apparatus10 and the “multifunction peripheral” to enable a print operation duringthe execution of the “information providing mode”.

When the device 12 is the “projector” and the “visual” providing methodis used, the information providing part 28 provides information forrecommending, to the user, documents that have ever been projected onthe “projector” during the execution of the “information providingmode”. For example, when the user is identified, the informationproviding part 28 may search for documents that have ever been used bythe user for projection and display information related to the documentson the UI part 18. The information providing part 28 may search fordocuments that have ever been used by a different user for projectionand display information related to the documents on the UI part 18.

When the device 12 is the “projector” and the “audio” providing methodis used, the information providing part 28 does not provide dependentinformation by sound in default settings because of the assumption thatplural users gather to use the “projector”. During the execution of the“information providing mode”, the control part 26 controls the UIapparatus 10 and the “projector” so that the “projector” may projectdetailed information on the information that is provided by theexecution of the “information providing mode”. In this case, the“projector” may project information that is output as audio information.

When the device 12 is the “projector” and the “general” providing methodis used and when plural users are detected in the first area 40, theinformation providing part 28 searches for and provides additionalinformation on contents of information that is projected on the“projector” and on contents specified by the user in the information.

When the “visual” providing method is used for the “devices in general”and when a bottom-to-top line of sight of the user is detected, theinformation providing part 28 displays operation part information asuser interface information at the bottom of the display part of the UIpart 18 in the “operating mode”. For example, the operation partinformation is a keyboard displayed on the display part.

When the “audio” providing method is used for the “devices in general”and when the detected user is located at a distance (for example, whenthe user is located outside the second area 42 or when the user islocated within the second area 42), the information providing part 28turns up the volume while information is provided. Further, the controlpart 26 increases the sensitivity of detection of audio input. When itis detected that the user has executed an action (gesture) of puttingthe finger to lips, the information providing part 28 turns down thevolume while the user is staying (for example, while the user isdetected).

Specific examples of this exemplary embodiment are described below.

SPECIFIC EXAMPLE 1

Specific Example 1 is described with reference to FIGS. 10A to 11C.FIGS. 10A to 10D illustrate details of the operation of the UI apparatus10 and the like in Specific Example 1. FIGS. 11A to 11C illustratepositional relationships in Specific Example 1. For example, the device12 is the image forming device.

FIG. 10A illustrates a situation corresponding to the positionalrelationship illustrated in FIG. 11A. That is, when the user 38 islocated outside the second area 42 as illustrated in FIG. 11A (when thepositional relationship corresponds to the positional relationship (a1)in FIG. 8), the information providing part 28 executes the publicproviding mode (reference symbol 44A) irrespective of the user's action.The user 38 intends to print materials for a technical meeting by usingthe image forming device serving as the device 12.

When the user has moved to a position in front of the image formingdevice (device 12) to enter the second area 42 as illustrated in FIG.11B, the positional relationship corresponds to the positionalrelationship (a4) in FIG. 8. Therefore, the information providing part28 executes the information providing mode (reference symbol 46B) or theoperating mode (reference symbol 46C) based on the user's action.

FIG. 10B illustrates a situation corresponding to the positionalrelationship illustrated in FIG. 11B. In this situation, the action α orthe action β is detected as the action of the user 38 and theinformation providing part 28 executes the information providing mode asa mode corresponding to the positional relationship and the action α orthe action β. At this time, the information providing part 28 identifiesthe user 38 by acquiring information on the user 38 (user information)and provides dependent information related to the user. For example, theinformation providing part 28 may acquire schedule information ororganization information of the user 38, acquire information related tothe schedule or the organization from a different apparatus (forexample, an in-house server or a different device), and provide theacquired information. As described above, the user information isacquired by applying an authentication technology or the like. In theexample illustrated in FIG. 10B, the information providing part 28acquires information in a company to which the user 38 belongs from adifferent apparatus (for example, an in-house server) and provides theinformation in the company. For example, when the user 38 belongs to atechnology development department, the information providing part 28 mayprovide information related to the technology development department ora different technology development department or may provide informationrelated to a department associated with the technology developmentdepartment to which the user 38 belongs (for example, a researchdepartment or a sales department). The information providing part 28 mayprovide information to the user 38 by selecting the information based onhistory information of a different user (for example, information on ahistory of use of information or devices). The information may bedisplayed on the display part of the UI part 18 or may be output asaudio information.

The information providing part 28 may provide the information in thecompany while the user is operating the image forming device (device 12)(for example, while the user is printing materials for a technicalmeeting by using the image forming device). The information providingpart 28 may propose printing the information in the company togetherwith the materials that the user intends to print initially.

When the user has moved to a position in front of the UI apparatus 10 toenter the first area 40 as illustrated in FIG. 11C, the positionalrelationship corresponds to the positional relationship (a3) in FIG. 8.Therefore, the information providing part 28 executes the conversationmode (reference symbol 46A), the information providing mode (referencesymbol 46B), or the operating mode (reference symbol 46C) based on theuser's action.

FIG. 10C illustrates a situation corresponding to the positionalrelationship illustrated in FIG. 11C. In this situation, the action β isdetected as the action of the user 38 and the information providing part28 executes the conversation mode (reference symbol 46A) as a modecorresponding to the positional relationship and the action β. That is,it is detected that the user has executed an action of turning the lineof sight to the UI apparatus 10 (action β) and the information providingpart 28 executes the conversation mode based on the detection result. Inthe conversation mode, for example, when the user 38 has instructed theUI apparatus 10 to print the information in the company that is proposedby the information providing part 28, the UI apparatus 10 controls theimage forming device (device 12) to print the information in thecompany. The user 38 may give the print instruction to the UI apparatus10 by voice or by operating the display part of the UI part 18.

When the user 38 has moved away from the UI apparatus 10 and the imageforming device (device 12) to the outside of the second area 42 asillustrated in FIG. 10D, the positional relationship corresponds to thepositional relationship (a1) in FIG. 8. Therefore, the informationproviding part 28 executes the public providing mode (reference symbol44A).

SPECIFIC EXAMPLE 2

Specific Example 2 is described with reference to FIGS. 12A to 13C.FIGS. 12A to 12D illustrate details of the operation of the UI apparatus10 and the like in Specific Example 2. FIGS. 13A to 13C illustratepositional relationships in Specific Example 2. For example, the device12 is the image forming device.

FIG. 12A illustrates a situation corresponding to the positionalrelationship illustrated in FIG. 13A. That is, when the user 38 islocated outside the second area 42 as illustrated in FIG. 13A (when thepositional relationship corresponds to the positional relationship (a1)in FIG. 8), the information providing part 28 executes the publicproviding mode (reference symbol 44A) irrespective of the user's action.The user 38 intends to claim travel expenses.

When the user 38 has moved to a position in front of the UI apparatus 10to enter the first area 40 as illustrated in FIG. 13B, the positionalrelationship corresponds to the positional relationship (a3) in FIG. 8.Therefore, the information providing part 28 executes the conversationmode (reference symbol 46A), the information providing mode (referencesymbol 46B), or the operating mode (reference symbol 46C) based on theuser's action.

FIG. 12B illustrates a situation corresponding to the positionalrelationship illustrated in FIG. 13B. When the action β is detected asthe action of the user 38 in this situation, the information providingpart 28 executes the conversation mode (reference symbol 46A) as a modecorresponding to the positional relationship and the action β. That is,when it is detected that the user has executed an action of turning theline of sight to the UI apparatus 10 (action β), the informationproviding part 28 executes the conversation mode based on the detectionresult. At this time, the information providing part 28 identifies theuser 38 by acquiring information on the user 38 (user information). Forexample, the information providing part 28 acquires schedule informationor organization information of the user 38. In the example illustratedin FIG. 12B, the user 38 requests the claim on travel expenses by audioinput and information indicating the request is input to the UIapparatus 10. The user 38 may input the request to the UI apparatus 10by operating the screen of the UI part 18. When the informationproviding part 28 has received the request for the claim on travelexpenses from the user 38, the information providing part 28 checks thepresence or absence of travels of the user 38 by referring to theschedule information of the user 38. For example, when informationindicating a travel whose travel expenses have not been claimed yet (forexample, information indicating a travel to “New York”) is registered inthe schedule information, the information providing part 28 providesinformation related to the travel. The information providing part 28 mayprovide the information related to the travel as audio information ormay display the information on the display part of the UI part 18. Inthe example illustrated in FIG. 12B, the information related to thetravel is provided to the user 38 by sound.

When the user 38 has requested, by audio input, the claim on travelexpenses indicated by the information provided by the informationproviding part 28 as illustrated in FIG. 12C, the UI apparatus 10submits a reimbursement claim on travel expenses. When the user 38 hasrequested another claim on travel expenses by audio input (for example,a claim on travel expenses of a travel to “Boston”), the UI apparatus 10submits a reimbursement claim on the travel expenses together. The user38 may request the UI apparatus 10 for the claim on travel expenses byoperating the screen of the UI part 18.

The UI apparatus 10 may control the image forming device (device 12) toprint an application form. In this case, for example, the UI apparatus10 may control the image forming device (device 12) to print anapplication form when the user has moved to a position in front of theimage forming device as illustrated in FIG. 13C and the UI apparatus 10has detected the movement. When a signature is required, the informationproviding part 28 may provide information indicating that a signature isrequired.

When the user 38 has moved away from the UI apparatus 10 and the imageforming device (device 12) to the outside of the second area 42 asillustrated in FIG. 12D, the positional relationship corresponds to thepositional relationship (a1) in FIG. 8. Therefore, the informationproviding part 28 executes the public providing mode (reference symbol44A).

SPECIFIC EXAMPLE 3

Specific Example 3 is described with reference to FIGS. 14A to 15B.FIGS. 14A to 14D illustrate details of the operation of the UI apparatus10 and the like in Specific Example 3. FIGS. 15A and 15B illustratepositional relationships in Specific Example 3. For example, the device12 is the image forming device.

In Specific Example 3, an error has occurred in the image forming device(device 12). Specifically, there has occurred such an error that paper(for example, letter-size paper) is not contained in the image formingdevice. In this case, the information providing part 28 providesinformation indicating that the error has occurred in the image formingdevice by executing the conversation mode irrespective of the positionalrelationship and the details of the user's action. For example, theinformation providing part 28 provides the error information even if theuser 38 is located outside the second area 42 as illustrated in FIG. 15A(even if the positional relationship corresponds to the positionalrelationship (a1) in FIG. 8). In the example illustrated in FIG. 14A,the information providing part 28 provides the error information bysound. For example, the error information is provided by soundindicating a message “LETTER-SIZE PAPER HAS RUN OUT. PLEASE REFILL THETRAY WITH PAPER.” The information providing part 28 may display theerror information on the display part of the UI part 18 together with orwithout using sound.

When the user 38 has moved to a position in front of the image formingdevice (device 12) to enter the second area 42 as illustrated in FIG.15B, the information providing part 28 executes the conversation mode toprovide information indicating further details of the error or worknecessary to correct the error. That is, when the user 38 is locatedoutside the second area 42, the information providing part 28 executesthe conversation mode to provide the error information for the purposeof notifying the user 38 that the error has occurred in the imageforming device (device 12). When the user 38 has moved to a positionnear the image forming device (device 12) (for example, in front of theimage forming device), it is predicted that the possibility of work forerror correction by the user 38 is higher than in the case in which theuser 38 is located outside the second area 42. Therefore, when the user38 has moved to a position in front of the image forming device, theinformation providing part 28 provides the information indicatingfurther details of the error or work necessary to correct the errorcompared with the case in which the user 38 is located outside thesecond area 42. FIG. 14B illustrates the situation at that time. Forexample, the information providing part 28 outputs a paper replenishingprocedure by sound. The information providing part 28 may displayinformation indicating the procedure (for example, an image or acharacter string) on the display part of the UI part 18. The informationproviding part 28 may provide the information indicating further detailsof the error or necessary work when the user has inquired details of theerror from the UI apparatus 10. In the example illustrated in FIG. 14B,the user inquires the tray that has run out of paper and the informationproviding part 28 provides information indicating the tray to bereplenished with paper as a response to the inquiry.

The control part 26 of the UI apparatus 10 may detect, for example, aportion or function having a possibility of occurrence of an error inthe device 12 (for example, the image forming device). For example, whenthe remaining amount of a consumable item contained in the device 12becomes equal to or lower than a threshold, the control part 26 maydetermine that an error may occur. When a portion or function having apossibility of occurrence of an error is detected (for example, when theremaining amount of a consumable item becomes equal to or lower than athreshold), the information providing part 28 may provide informationindicating that a portion or function having a possibility of occurrenceof an error is detected and information indicating work necessary toavoid the occurrence of an error.

For example, when the remaining number of sheets of legal-size paper isequal to or lower than a threshold, the information providing part 28may propose replenishment of legal-size paper to the user 38 asillustrated in FIG. 14C.

FIG. 14D illustrates a situation after the error has been corrected(after paper has been replenished). Similarly to Specific Examples 1 and2, when the user 38 is identified and gives a print instruction by voiceor by screen input, the image forming device executes printing intendedby the user 38.

When an error has occurred in the image forming device (device 12) butdetails of the error do not affect the user's request, the UI apparatus10 may cause the image forming device to execute processing in responseto the user's request. For example, when the processing indicated by theuser's request is scanning processing, paper is not necessary andtherefore the UI apparatus 10 causes the image forming device to executethe scanning processing. The UI apparatus 10 may propose, to the user38, a different device (for example, an image forming device) having noerror.

SPECIFIC EXAMPLE 4

Specific Example 4 is described with reference to FIGS. 16A to 17B.FIGS. 16A to 16D illustrate details of the operation of the UI apparatus10 and the like in Specific Example 4. FIGS. 17A and 17B illustratepositional relationships in Specific Example 4. For example, the device12 is the image forming device.

For example, when the user 38 is located outside the second area 42 asillustrated in FIG. 17A (when the positional relationship corresponds tothe positional relationship (a1) in FIG. 8), the information providingpart 28 executes the public providing mode (reference symbol 44A)irrespective of the user's action. The user 38 intends to print salesmaterials.

When the user 38 has moved to a position in front of the UI apparatus 10to enter the first area 40 as illustrated in FIG. 17B, the positionalrelationship corresponds to the positional relationship (a3) in FIG. 8.Therefore, the information providing part 28 executes the conversationmode (reference symbol 46A), the information providing mode (referencesymbol 46B), or the operating mode (reference symbol 46C) based on theuser's action.

FIG. 16A illustrates a situation corresponding to the positionalrelationship illustrated in FIG. 17B. When the action β is detected asthe action of the user 38 in this situation, the information providingpart 28 executes the conversation mode (reference symbol 46A) as a modecorresponding to the positional relationship and the action β. That is,when it is detected that the user has executed an action of turning theline of sight to the UI apparatus 10 (action β), the informationproviding part 28 executes the conversation mode based on the detectionresult. At this time, the information providing part 28 identifies theuser 38 by acquiring information on the user 38 (user information). Forexample, the information providing part 28 acquires scheduleinformation, organization information, or information on years ofemployment of the user 38.

In the example illustrated in FIG. 16A, the user 38 requests creation ofsales materials by audio input and information indicating the request isinput to the UI apparatus 10. The user 38 may input the request to theUI apparatus 10 by operating the screen of the UI part 18. When theinformation providing part 28 has received the request for the creationof sales materials from the user 38, the information providing part 28acquires information related to the materials from a different apparatus(for example, an in-house server, a different device, or the Internet)and creates sales materials unique to the user 38 based on the acquiredmaterials. For example, the information providing part 28 determines thevolume and quality of sales materials based on a history of employmentof the user 38 or a record of accomplishments in the company (thosepieces of information are acquired as user information) and createssales materials having the determined volume and quality. For example,when a value indicating the years of employment of the user 38 is equalto or lower than a threshold, the information providing part 28 createssales materials having a larger volume than in a case in which the valueindicating the years of employment is higher than the threshold. Whenthe value indicating the years of employment is higher than thethreshold, the information providing part 28 creates more concise salesmaterials. The information providing part 28 may determine the volumeand quality of sales materials based on a use history of the user 38.For example, when there is such a history that the user 38 has evercreated sales materials having a large volume, the information providingpart 28 creates sales materials having a larger volume based on thehistory. When there is such a history that the user 38 has ever createdconcise sales materials, the information providing part 28 createsconcise sales materials based on the history. The information providingpart 28 may determine the volume and quality of sales materials based onthe job title or authority of the user 38. For example, the informationproviding part 28 may create more concise sales materials as the jobtitle or authority of the user 38 is a higher grade. Thus, the user 38is identified and information unique to the user 38 is provided.

The information providing part 28 provides the sales materials to theuser 38. For example, the information providing part 28 displays thesales materials on the display part of the UI part 18 as illustrated inFIG. 16B. At this time, the information providing part 28 may switch theoperation mode from the conversation mode to the operating mode or mayexecute both of the conversation mode and the operating mode. In theoperating mode, the user 38 is allowed to edit the sales materialscreated by the information providing part 28. In the example illustratedin FIG. 16B, both of the conversation mode and the operating mode areexecuted.

When the action γ is detected as the action of the user 38, theinformation providing part 28 executes the operating mode as illustratedin FIG. 16C. That is, the positional relationship corresponds to thepositional relationship (a3) in FIG. 8 and the action of the user 38corresponds to the action γ. Therefore, the operation mode is switchedto the operating mode. In the operating mode, the user 38 is allowed toedit the sales materials created by the information providing part 28and to give an instruction to output the sales materials.

When the user 38 has instructed the UI apparatus 10 to print the salesmaterials by audio input or by operating the screen, the UI apparatus 10causes the image forming device (device 12) to print the sales materialsin accordance with the instruction. At this time, the informationproviding part 28 may output a message about execution of printing bysound as illustrated in FIG. 16D or may display the message on thescreen of the UI part 18.

The information providing part 28 may provide supplementary informationto the user 38. For example, the information providing part 28 mayacquire, as the supplementary information, information indicating a mapshowing the route to the sales destination of the user 38 and cause theimage forming device to print the map. The information providing part 28may identify the sales destination based on the schedule of the user 38or the conversation with the user 38. The information providing part 28may determine whether to provide the supplementary information based onthe years of employment, the job title, the authority, or the like ofthe user 38. For example, the information providing part 28 may providethe supplementary information when the value indicating the years ofemployment is equal to or lower than the threshold or when the grade ofthe job title or authority is equal to or lower than that of apredetermined job title or authority. The information providing part 28need not provide the supplementary information in other cases. Theinformation providing part 28 may determine whether to provide thesupplementary information based on a sales history of the user 38. Forexample, the information providing part 28 may provide the supplementaryinformation when the user 38 has not ever visited the sales destination.The information providing part 28 need not provide the supplementaryinformation in other cases. Information indicating the sales history isacquired as user information.

The information providing part 28 may store data on the sales materialscreated by the instruction from the user 38 in a storage area (forexample, a storage device provided in an in-house server). Theinformation providing part 28 may associate attribute information of theuser (for example, information indicating sales materials forinexperienced employees, for experienced employees, or for managers orhigher-grade titles) with the data on the sales materials. In thismanner, materials that are once created may be used for other purposes.

According to the exemplary embodiment described above, the operationmode is executed based on the positional relationship among the user,the UI apparatus 10, and the device 12, the user's action, the state ofthe device 12, and the like and the independent information or thedependent information is provided to the user. Thus, information isprovided to the user in response to the user's request.

In the exemplary embodiment described above, a single device 12 isincluded in the device system but plural devices 12 may be included inthe device system. When plural devices 12 are included in the devicesystem, the areas described above (first area 40 and second area 42) maybe defined for each individual device 12 and the UI apparatus 10 mayexecute the operation mode for each individual device 12 based on apositional relationship between the user and the areas. For example, thefirst area 40 and the second area 42 are defined for a first device andthe first area 40 and the second area 42 are defined for a seconddevice. The information providing part 28 executes the public providingmode or an on-demand providing mode related to the first device based onthe positional relationship between the areas defined for the firstdevice and the user and based on the user's action. Similarly, theinformation providing part 28 executes the public providing mode or anon-demand providing mode related to the second device based on thepositional relationship between the areas defined for the second deviceand the user and based on the user's action. The information providingpart 28 may execute the operation mode based also on the state of thefirst device or may execute the operation mode based also on the stateof the second device.

Each of the UI apparatus 10, the device 12, and the terminal apparatus14 is implemented by, for example, cooperation between hardware andsoftware. Specifically, each of the UI apparatus 10, the device 12, andthe terminal apparatus 14 includes one or plural processors such as CPUs(not illustrated). The one or plural processors read and execute aprogram stored in a storage device (not illustrated), therebyimplementing the functions of the respective parts of each of the UIapparatus 10, the device 12, and the terminal apparatus 14. The programis stored in the storage device via a recording medium such as a CD or aDVD or via a communication path such as a network. As another example,the respective parts of each of the UI apparatus 10, the device 12, andthe terminal apparatus 14 may be implemented by hardware resources suchas a processor, an electronic circuit, or an application specificintegrated circuit (ASIC). A device such as a memory may be used for theimplementation. As still another example, the respective parts of eachof the UI apparatus 10, the device 12, and the terminal apparatus 14 maybe implemented by a digital signal processor (DSP) or a fieldprogrammable gate array (FPGA).

The foregoing description of the exemplary embodiment of the presentinvention has been provided for the purposes of illustration anddescription. It is not intended to be exhaustive or to limit theinvention to the precise forms disclosed. Obviously, many modificationsand variations will be apparent to practitioners skilled in the art. Theembodiment was chosen and described in order to best explain theprinciples of the invention and its practical applications, therebyenabling others skilled in the art to understand the invention forvarious embodiments and with the various modifications as are suited tothe particular use contemplated. It is intended that the scope of theinvention be defined by the following claims and their equivalents.

What is claimed is:
 1. An information processing apparatus, comprising:an acquirer that acquires information indicating a request from a user;and a controller that causes, in response to the request, a provider toprovide first information that does not depend on a device or secondinformation that depends on the device.
 2. The information processingapparatus according to claim 1, wherein the first information isinformation that is not unique to the user, and wherein the secondinformation is information unique to the user.
 3. The informationprocessing apparatus according to claim 2, wherein the request ispresumed based on a position of the user.
 4. The information processingapparatus according to claim 1, wherein, as processing in response tothe request, the controller controls provision of the first informationor the second information based on a positional relationship among theuser, the device, and the provider.
 5. The information processingapparatus according to claim 4, wherein a plurality of areas are definedbased on a position of at least one of the device and the provider, andwherein the controller controls the provision of the first informationor the second information based on a positional relationship between theuser and each of the areas.
 6. The information processing apparatusaccording to claim 4, wherein the controller changes contents of thesecond information based on the positional relationship.
 7. Theinformation processing apparatus according to claim 6, wherein aplurality of areas are defined based on a position of at least one ofthe device and the provider, and wherein the controller changes thecontents of the second information based on a positional relationshipbetween the user and each of the areas.
 8. The information processingapparatus according to claim 6, wherein the controller controls, basedon the positional relationship, execution of a first mode for holding aconversation with the user, a second mode for providing informationrelated to the user, or a third mode for providing information relatedto an operation for the device as a mode for providing the secondinformation.
 9. The information processing apparatus according to claim4, wherein the controller changes contents of the second informationbased on the positional relationship and an action of the user.
 10. Theinformation processing apparatus according to claim 9, wherein thecontroller controls, based on the positional relationship and the actionof the user, execution of a first mode for holding a conversation withthe user, a second mode for providing information related to the user,or a third mode for providing information related to an operation forthe device as a mode for providing the second information.
 11. Theinformation processing apparatus according to claim 10, wherein thecontroller controls the execution of the first mode, the second mode, orthe third mode based on the positional relationship, the action of theuser, and a state of the device.
 12. The information processingapparatus according to claim 11, wherein the controller controls theexecution of the first mode when the state of the device corresponds toan error state.
 13. The information processing apparatus according toclaim 12, wherein the controller controls, as the execution of the firstmode, provision of information related to a different device that meetsthe request.
 14. The information processing apparatus according to claim13, wherein the controller preferentially provides the informationrelated to the different device when the different device is locatedcloser to a position of the user.
 15. The information processingapparatus according to claim 11, wherein the controller controls theexecution of the second mode or the third mode based on the action ofthe user when the state of the device corresponds to an error state. 16.The information processing apparatus according to claim 1, wherein theprovider is a user interface having at least one of a display functionand an audio output function, and wherein each of the first informationand the second information includes at least one of visual informationand audio information.
 17. The information processing apparatusaccording to claim 1, wherein the controller changes how the firstinformation and the second information are provided based on a type ofthe device.
 18. The information processing apparatus according to claim1, wherein the controller changes how the first information and thesecond information are provided based on a type of the provider.
 19. Theinformation processing apparatus according to claim 1, wherein thecontroller controls provision of information related to a plurality ofdevices as the second information.
 20. A non-transitory computerreadable medium storing a program causing a computer to execute aprocess comprising: acquiring information indicating a request from auser; and providing, in response to the request, first information thatdoes not depend on a device or second information that depends on thedevice.